A minimal model for tag-based cooperation 
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Recently, Riolo et al. [R. L. Riolo et al., Nature 414, 441 (2001)] showed by computer simulations 
that cooperation can arise without reciprocity when agents donate only to partners who are suffi- 
ciently similar to themselves. One striking outcome of their simulations was the observation that 
the number of tolerant agents that support a wide range of players was not constant in time, but 
showed characteristic fluctuations. The cause and robustness of these tides of tolerance remained 
to be explored. Here we clarify the situation by solving a minimal version of the model of Riolo et 
al. It allows us to identify a net surplus of random changes from intolerant to tolerant agents as a 
necessary mechanism that produces these oscillations of tolerance which segregate different agents in 
time. This provides a new mechanism for maintaining different agents, i.e. for creating biodiversity. 
In our model the transition to the oscillating state is caused by a saddle node bifurcation. The 
frequency of the oscillations increases linearly with the transition rate from tolerant to intolerant 
agents. 

PACS numbers; 02.50.Le, 87.23.-n, 89.65.-s 



I. INTRODUCTION 

The emergence of cooperation in evolving populations 
with exploitative individuals is still a challenging prob- 
lem in biological and social sciences. Most theories that 
explain cooperation are based on direct reciprocity, as 
the famous iterated prisoner's dilemma Cooperation 
can also arise from indirect reciprocity when agents help 
others only if these are known as sufficiently altruistic 
. In most of these models a finite population of agents 
is simulated, pairs of agents meet randomly as poten- 
tial donator and receiver. A donation involves some cost 
to the donor while it provides a larger benefit to the re- 
ceiver. Agents reproduce depending on their payoffs after 
a certain number of such meetings. Obviously selfish in- 
dividuals that do not donate would quickly spread in the 
population if help is not channeled towards more cooper- 
ative players. If agents do not meet repeatedly — as in a 
large population — direct reciprocity does not work. Indi- 
rect reciprocity can solve this problems when donations 
are given only to those individuals that are known as 
sufficiently helpful. This mechanism effectively protects 
a cooperative population against exploiters . 

Riolo et al. Q introduced a model in which coopera- 
tion is not based on reciprocity, but on similarity. In this 
model donations are channeled towards individuals that 
are sufficiently similar to the donator. To distinguish be- 
tween different groups of individuals every agent i has 
a tag Ti G [0,1]. School ties, club memberships, tribal 
costumes or religious creeds are all tags that induce co- 
operation. In addition agents have a tolerance threshold 
Ti > 0, which determines the tag interval that the agent 
classifies as its own group. An agent i donates to another 
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agent j if their tags are sufficiently similar, jr^ — Tj | < T^. 
The cost of such a donation for i is c > while the benefit 
for J is & > c. For simplicity, b is normalized to 1, since 
a multiplication of payoffs with a constant factor does 
not change the game. Initially, the tag and the tolerance 
threshold are uniformly distributed random numbers. In 
each generation every agent acts as a potential donor for 
P other agents chosen at random. Hence it is on average 
also chosen P times as a recipient. After each generation 
each agent i compares its payoff with the payoff of an- 
other randomly chosen agent j and adopts Tj and tj if j 
has a higher payoff. In addition every agent is subject to 
mutation. With probability 0.1 an agent receives a new 
T drawn from a uniform distribution and also with prob- 
ability 0.1 a new T which is Gaussian distributed with 
standard deviation a — 0.01 around the old T. If this new 
T becomes smaller than zero it is set to 0. Obviously, it 
seems to be the best strategy for an individual to donate 
as little as possible, i.e. to have a very small T. However, 
the whole population would be better off if everybody 
would cooperate. This "tragedy of the commons" can be 
solved in different ways, e.g. by volunteering 

Riolo et al. solve this problem by channeling help to- 
wards others that are sufficiently similar to the dona- 
tor. Instead of a cooperative population the formation 
and decay of cooperative clusters is observed for certain 
parameter ranges (high P and low c, see Fig. The 
average tolerance of a cooperative cluster grows slowly 
over time. Occasionally it declines sharply. This decline 
occurs when the cluster is exploited by agents that are 
sufficiently similar to the cluster's agents to get support, 
but do not help themselves. However, the mechanism 
that generates these tides of tolerance remained unclear 

Here we develop a minimal model for tag-based coop- 
eration that displays these "tides of tolerance" if there is 
a net average drift towards more cooperation. We find 
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FIG. 1: Population dynamics for the first 500 generation of 
the model of Riolo et al. 0. The average tolerance and the 
donationrate — i.e. the fraction of encounters that lead to a 
donation — show fluctuations. When a cooperative cluster be- 
comes dominant its tolerance increases until the cluster be- 
comes extinct, (c — 0.1, 6 — 1.0, P = 3). 



that these fluctuations vanish if such a drift is not in- 
cluded in the model. The importance of this observation 
stems from the fact that if we have species that can dis- 
tinguish between themselves and others and donate only 
to others with the same tag, then this would in the long 
run lead to a single group of cooperating species having a 
single tag. But if we introduce a small rate of biased con- 
versions from intolerant to tolerant species we observe a 
waxing and waning in time of species with different tags. 
In other words, the small conversion rate leads to a coex- 
istence of different species where different species appear 
cyclically at different times. This consitutes a new mech- 
anism that generates biodiversity in a group of competing 
species. 

This paper is organized as follows. First the model 
of Riolo et al. is simplified in order to allow an analyt- 
ical treatment. Then the system without the effects of 
mutations is analyzed. Thereafter we introduce a drift 
that increases the tolerance and leads to oscillations of 
tolerance. We show that the truncated mutations in the 
model of Riolo et al. also lead to such a drift. 



II. SIMPLIFIED REPLICATOR MODEL 

A. Definition of the model 

Here we simplify the model of Riolo et al. fsj in order 
to allow for an analytical treatment. In a first step we re- 
strict the game to only two tags, red and blue. Similarly 
we allow only two tolerances. The agents can either only 
donate to others bearing the same tag if they have zero 
tolerance T = or to every other agent (T = 1). This 
leads to four possible strategies. Then we allow partners 



to donate and to receive in an single interaction instead 
of defining different roles for donators and receivers. We 
end up with the payoff matrix 
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The strategies with T — I are obviously dominated by 
the strategies with T — 0, because the payoff of an in- 
tolerant player is always larger than the payoff of the 
corresponding tolerant player. There are pure Nash equi- 
libria for the intolerant strategies (red, 0) and (blue, 0). 
In addition there is an evolutionary instable mixed Nash 
equilibrium if these two strategies are used with proba- 
bihty i. 

If the intolerant agents do not even cooperate within 
their own group we recover the prisoners dilemma ^ , see 
Appendix 1X1 

Instead of simulating a finite group of agents we calcu- 
late only the evolution of the probability that an agent 
uses a certain strategy. In the following, pi and p2 
are the frequencies of tolerant red and tolerant blue 
agents, respectively, ps and p4 are the frequencies of 
the corresponding red and blue intolerant agents. As 
Pi + P2 + Ps + pi = 1 the state of the system is com- 
pletely determined by p* = (Pi,P2jP3)- The trajectory 
can therefore be visualized as a trajectory in the three 
dimensional simplex shown in Fig. |21 

In order to apply standard replicator dynamics we 
calculate the mean payoffs from the payoff matrix as 
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where 11^ is the payoff of the strategy with frequency pi. 
With (P) the replicator equations can be written as 

p*+i=p*-i-p*/3(n*-(n)*), (2) 

where i = 1,..,4. Here (3 determines the time scale. In 
the following we set /3 = 1. Our main interest is the 
attractors of the system, and a modification of (3 would 
only modify the velocities on the attractor. 



B. Fixed points and separatrix 

The dynamics of the system Q can roughly be char- 
acterized as follows, see Fig. |2 Most initial conditions 
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lead to fixed points where only one tag survives. The fre- 
quency of intolerant players is typically higher than the 
frequency of tolerant players here. There is a separatrix 
that divides the basins of attraction of the two tags. On 
one side of the separatrix red players will survive and on 
the other side blue players. In addition we find several 
fixed points on the edges described in the following. 



P3 




P2 

FIG. 2: The trajectories of the replicator dynamics move from 
the inside of the simplex onto the boundaries. The corners 
represent the pure strategies pi. Arrows indicate the stabil- 
ity of the fixed points at the edges. There are two stable 
attractors called p'^'^'' and p''"'' (dark grey) corresponding to 
stable lines of fixed points of At the top only players 
with red tags survive whereas at the bottom where only play- 
ers with blue tags can exist. The two basins of attractions of 
these stable attractors are separated by a planar separatrix 
given by (|3J . This separatrix is the basin of attraction for the 
fixed point in the Nash equilibrium indicated by a black circle 
(c = 0.4, b = 1.0). 

As in any replicator system the mixed Nash equilib- 
rium p" = (0,0, i) is a fixed point. Here the basin of 
attraction is the separatrix. The separatrix shown in 
Fig. 121 can be calculated from the stability of this fixed 
point, which is discussed for a more general case in Ap- 
pendix^ p" is always part of the separatrix, its normal 
corresponds to the eigenvector 63 = (1 — c, 1 -|- c, 2) of 
the corresponding Jacobi matrix J" with the eigenvalue 
A3 — > 1. We find the equation 

P^ = ^[l-(l-c)p?-(l + c)p^] (3) 

for points on the separatrix. As we have 
(p*+i(pf,p|,p§) - p*(pf,p|,p|)) • eg = the system 
never leaves this plane again. 

In addition there are two fixed lines if only one tag 
is present: p'^'^'' = (1 - x, 0, x) and = (0, 1 - x, 0) 

where < a; < 1 is the fraction of intolerant players. 
The stability of the fixed points on these lines depends 



on X. For l — x>c the points are instable and intolerant 
players with the opposite tag can invade (see Appendix 
IB)| . Finally, there is an instable fixed line for a completely 
tolerant population, p"'"+ = {1 — y, y, 0), where < y < 1. 
The stability of this fixed line is discussed in Appendix 

m 

So far the system does not show any oscillation. It sim- 
ply relaxes to one of the fixed points described above. In 
the next section a mechanism that generates oscillations 
will be discussed. 



III. INTRODUCTION OF A BIASED DRIFT 

In order to generate oscillations in the system we have 
to destabilize the attracting fixed points and force the 
system through the separatrix. This can be realized by 
introducing first ad hoc a drift that increases the fraction 
of tolerant agents at the cost of the intolerant fraction of 
the same tag. If we introduce such biased conversions 
into our model equation (0) becomes 

P'^' = p\+p\{ul~{Ut))+epl (4) 

^ pI + pI (n^ - (n*)) +e{i-pl-pl- pI) 
p\^' = p\ + p\{nl-{\it))-sp\. 

The solution of these equations shown in Fig. 0] and Fig. 
O display oscillations in tolerance. These oscillations can 
be considered as the deterministic equivalent to the tides 
of tolerance in Q . 

In the model of Riolo et al. Q such a drift is gen- 
erated by truncated mutations. The average tolerance 
is usually of the order of a Therefore the truncation of 
negative tolerances decreases the probability for muta- 
tions that lower the tolerance and leads to a drift towards 
higher tolerances. We repeated the simulations of Riolo 
et al. and found that 50.0% of the tolerance mutations 
increase T while only 39.8% decrease T. The average mu- 
tation increases T by 1.3 • 10"'* (c = 0.1, P = 3, average 
over 10 000 realizations with 30 000 generations each). 
If we omit the tolerance mutations in the model of Ri- 
olo et al. one (low) tolerance is quickly inherited by the 
whole populations, see Fig. O The majority of players 
belongs to a dominant cluster. The mean tag of this 
cluster — and hence the donationrate — drifts slowly due 
to mutations of the tags. Without mutations of the tags 
one tag is inherited by the whole population after a short 
initial period. Consequently the donation rate becomes 
100%, and tolerance mutations do no longer infiucncc the 
system. 

A. Qualitative behavior 

The attractor of the system Q is shown in Fig. 01 
and the time evolution of the strategies can be seen in 
Fig. |S1 If initially all strategies are present the system 
shows periodic oscillations for small e and c = 0.1. One 
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FIG. 3: Population dynamics for the first 200 generation of 
tlie model of Riolo et al. 3] without tolerance mutations (left) 
and without tag mutations (right). Without tolerance muta- 
tions the donation rate fluctuates due to tag mutations. All 
players inherit the same tolerance after less than 100 genera- 
tions. Without tag mutations the donation rate quickly raises 
to 100% when all players have the same tag. The fluctuat- 
ing tolerance does no longer influence the system (c = 0.1, 
b= 1.0, P = 3). 



tag becomes dominant. The fraction of tolerant players 
increases due to the biased conversions imposed by £ > 
and intolerant players with the opposite tag can invade 
and destroy the cluster, giving rise to a new dominant 
cluster with the opposite tag. This attractor shown in 
Fig. 01 has essentially the whole simplex as a basin of at- 
traction. Only for very small or very high values of c 
other fixed points become stable. The system can be an- 
alyzed in two parts for e <C 1. Near the edges p^'^'^ and 
pfcitie replicator dynamics becomes irrelevant and the 
system is mainly driven by biased conversions. Further 
away from these edges the system is driven by the repli- 
cator dynamics. Here the dynamics is not altered by the 
biased conversions. 

Our biased conversions lead the system from an edge 
that is dominated by one color to an edge that is domi- 
nated by the other color. For small c the trajectory leaves 
these edges near the corners of the pure tolerant strate- 
gies, cf. Fig. 0] However, these corners are never crossed 
as they are fixed points. 



B. Fixed points 

Let us now analyze the system (0J in more detail. The 
fixed line p"^+ — {1 ~ y,y,0) of (O is still a fixed line of 
0). For c < 2 e a fraction of the fixed line remains stable, 
see Appendix^for details. However, as we are interested 
in e ^ 1 the fixed line is usually instable. Due to the flow 
from intolerant to tolerant players the edges p'''^'' and 
pbitie ^j,g longer fixed. The fixed point p" = (0, 0, ^) 
in the mixed Nash equilibrium moves away from the edge 




FIG. 4: Attractor of the system igj for c = 0.1. The black 
line is the attractor, the grey points are the fixed points. The 
plane is the separatrix for e = 0. The arrows indicate how 
the biased conversions drive the system through the separatrix 
to the corner with only tolerant individuals. Here individuals 
with the other tag can invade and steer the system to a corner 
with mostly intolerant individuals. Biased conversions lead 
to a tolerant corner again and the circle continues (e = 0.01, 
c = 0.1, b= 1.0). 



for e > and is now given by p'' = (e/c, e/c, ^ — e/c). 
The stability of this fixed point is discussed in Appendix 

In addition we find two more fixed points p*"*" and 
p*^. For e = they correspond to the points where the 
population with only one tag loses stability. These fixed 
points can be calculated analytically, see Appendix ICl for 
details. The expansion for e ^ 1 of p'^^ is 
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Due to the symmetry in the tags p*~ can easily be cal- 
culated by exchanging pi with p2 and ps with pi = 
I — Pi — P2 ^ P3- As described above we find p*+ = 
(1 — c, 0, c) for e = 0. Increasing e moves it towards p**. 
For e = c(l — c)/4 p*^ and p"* collapse, here p*^ becomes 
stable. 

For c < 0.73 we have no fixed points that are stable in 
all directions. The whole simplex is essentially the basin 
of attraction of the attractor shown in Fig. ^ 



C. Bifurcation at e = 

The transition from the system without biased conver- 
sions, i.e. e = 0, to the system with biased conversions 
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FIG. 5: The waxing and waning of the four different groups 
of agents (red agents black, blue agents gray, full lines T = 1, 
dashed lines T — 0) are caused by the following mechanism. 
A cluster of tolerant red agents is invaded by intolerant blue 
agents which convert via directed mutations to their tolerant 
counterpart, giving rise to a blue cluster which is then invaded 
by red intolerant agents. Although initially the number of red 
and blue tolerant agents differed only by one percent a tiny 
number (0.5%) of intolerant agents of each tag is enough to 
generate large clusters that are segregated in time (e — 0.01, 
c = 0.1, b= 1.0). 



can be analyzed in detail by considering the Poincare 
map shown in Fig. ^ 

At e > the fixed lines where only one tag is present 
vanish. This is caused by a saddle node bifurcation [lo| . 
A fixed line disappears at this bifurcation, and a small 
channel is opened through which the system moves slowly 
to the other side of the separatrix. The width of this 
channel is controlled by e. For small e a linear depen- 
dence between e and the oscillation frequency of the at- 
tractor is observed as shown in Fig. [71 Such a linear 
dependence is expected in a saddle node bifurcation with 
linear perturbation terms ep^ and epi pT| . 

In our model two small channels are opened by e > 0, 
as the separatrix is crossed twice in one oscillation. The 
reinjection in our model is caused by the replicator dy- 
namics, which drives the system to the channel of the op- 
posite tag. The dependence of the oscillation frequency 
on the parameter e for c = 0.1 is shown in Fig. [3 For 
values of e > 0.02 the dynamic changes. Here the fixed 
points p-'""*" that become stable for e — c/2 begin to in- 
fluence the dynamical system. 



D. Influence of the cost of cooperation c 

Here we analyze the influence of the cost of cooper- 
ation c on our system by defining different measures of 
order in our model and by observing the influence of c 
on these measures. The donation rate is the probability 
that one player donates to another, d = (1 —pz{p2 +P4) — 
Pi{pi +^3))- The fraction of tolerant individuals can be 
measured as ptoi = {pi +P2) ,and the asymmetry between 
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FIG. 6: The Poincare map of the pi shows the "channel" 
through which the trajectory crosses the separatrix. The 
black lines are the function and the bisector. The distance 
between the function and the bisector has been magnified by 
a factor of 10. Therefore the course of iteration is drawn 
only schematically. A marks the point where the separatrix 
is crossed due to biased conversions from ps to pi . Here pi in- 
creases further, as the fraction p4 that exploits pi is still very 
small. For e = the function and the bisector will match, 
the separatrix can not longer be crossed (e = 0.01, c = 0.1, 
6= 1.0). 



the tags as a = \{pi +P3) — {p2 +P4}\- Here (•) denotes a 
time average. In addition an average over different initial 
conditions is necessary. 

Fig. |S1 shows that these measures display changes at 
c « 0.02, c « 0.66, c « 0.73, and c « 0.96. We now 
discuss the reasons for these transitions. For c < e the 



points p 



T+ 



(1 — y,?/, 0) are stable flxed points. In 



the case oi e < c < 2s only a part of this flxed line is 
stable, see Appendix IbI for details. For c > 2e these 
flxed points become instable, this leads to a decrease of 
the asymmetry between tags at c = 2 e 

For cooperation costs c > 2 e the typical qualitative be- 
havior is described above. The attractor of such a system 
can be seen in Fig. ^ For higher costs c the intolerant 
players can invade earlier as their advantage is larger. In 
the following we restrict ourselves to the case of e = 0.01. 
The qualitative behavior does not change until c « 0.661. 
The attractor for c — 0.66 can be seen in Fig.|5| 

For c > 0.661 the biased conversion can no longer drive 
the system through the separatrix. Two different attrac- 
tors are observed for different initial conditions. In the 
original model this behavior corresponds to the estab- 
lishment of one cooperative cluster which becomes tol- 
erant due to the truncated mutations. Intolerant indi- 
viduals with the other tag try to invade, but the domi- 
nant cluster becomes more intolerant again and prevents 
an invasion. At c « 0.73 the fixed points p** become 
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FIG. 7: Dependence of the oscillation frequency on the muta- 
tion rate e. The squares and the triangles are the numerical 
values for c = 0.1 and c = 0.2, respectively. The line is a fit 
of the frequencies for e < 0.01. For small e the frequency in- 
creases as / = ae'^. We found /? = 1.0036 ± 0.0003 for c = 0.1 
and (3 = 1.0021 ± 0.0002 for c = 0.2. A linear dependence is 
expected if the perturbation is linear in e, as in our case. For 
high values of e the fixed line p^"*" becomes partially stable 
for e = c/2 and begins to influence the system. Therefore the 
frequency decreases {b = 1.0). 



stable (see Appendix . For higher values of c oscil- 
lations are no longer observed. For one eigenvalue of 
the corresponding Jacobi matrix we had |Ai| < 1 
even for smaller c. In addition there is a pair of com- 
plex conjugated eigenvalues that crosses the unit circle 
at c « 0.73. Hence we are observing a Hopf-bifurcation 
here. For c > 0.73 the system spins into the fixed points 
p*^. For c w 0.93 the imaginary parts of the eigenvalues 
vanish. At c = i+%/i-i6e ^ o.96 the stable fixed points 
p** collapse with the instable fixed point p'' in a super- 
critical pitchfork bifurcation. For higher values of c the 
fixed point p'' is stable. 



IV. SUMMARY AND OUTLOOK 

We developed a minimal model for cooperation based 
on similarity. This model shows oscillations in the pop- 
ulation of tolerant agents as two different groups domi- 
nate the population successively. The mechanism that 
drives these oscillations is a drift towards more toler- 
ance. Without such a drift a cooperative cluster cannot 
be destabilized and will not give way to a new coopera- 
tive cluster. In other words, the temporally segregated 
dynamical coexistence of different tags is only possible 
if such a drift towards more tolerance exists. Without 
such a drift only one species would be selected. This 
is similar to the dynamical coexistence of species in the 
rock-paper-scissors game (12j . The drift provides a new 
mechanism for maintaining a dynamical biodiversity in 
biological systems l^. 

This mechanism prevents a single species from tak- 



FIG. 8: Influence of the cost c on the donation rate (squares), 
the fraction of tolerant players (triangles) and the asymme- 
try between the tags (diamonds). All symbols are averages 
over 10 000 initial conditions and 100-10 000 time steps. The 
number of time steps is taken as a uniformly distributed ran- 
dom number to exclude effects resulting from changes of the 
oscillation frequency. The lines are the analytical results for 
c > 0.73, see Appendix |C| The fraction of tolerant players 
decreases as the time intervals where the tag is invaded be- 
come longer. This has also an effect on the donation rate. 
For c ~ 0.66 a large change of the symmetry parameter is 
observed when one symmetric attractor is replaced by two 
attractors which are not symmetric. The fraction of tolerant 
players and the donation rate decrease slightly at c « 0.66. 
The donation rate and the symmetry parameter increase un- 
til the flxed points p"^ become stable at c ~ 0.73. Here 
these parameters decrease again. When p'' flnally becomes 
stable at c = i+vi^i-6 f_ ^ q gg symmetry is complete 
again.(e = 0.01, b = 1.0). 



ing over the whole population as it makes the dominant 
cluster vulnerable. Agents can therefore exploit the clus- 
ter by accepting support without supporting the cluster. 
These free-riders consequently destroy the cooperative 
cluster again. The cooperative cluster can only defend 
itself if the cost for cooperation is sufficiently high. In 
this case the free-riders can not take over the whole pop- 
ulation. 

The main results do not change if the number of tags 
is increased. However, the analytical treatment becomes 
much more complicated, as we have to deal with n — 1 
coupled nonlinear equations in the case of n tags. Yet, 
a population model seems to be more appropriate in the 
case of more tags, as our model shows a subsequent real- 
ization of all tags in the same order. 

If one analyzes a system with a spatial distribution of 
agents instead of the well mixed case described above 
one observes strong segregation between tags. Tolerant 
players need to protect themselves against intolerant ex- 
ploiters by building a border of intolerant agents around 
them. The spatially distributed system and the strategies 
that help to overcome the segregation will be discussed 
in lij. 
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FIG. 9: Attractor of the system (gj for c = 0.66. The black 
hne is the attractor. The grey points are the fixed points. 
The plane is the separatrix for e = 0. The arrows indicate the 
parts of the attractor where it is mainly driven by the biased 
conversions. The system does no longer cross the separatrix 
near the edges pi + pa = 1 and P2 + P4 = 1. Near the fixed 



of c there are two separated attractors ( c 
&= 1.0). 



0.66, e = 0.01, 



APPENDIX A: PRISONERS DILEMMA 

The introduction of "never cooperate" agents which do 
not donate at all Ts] instead of the zero tolerance agents 
eliminates the difference between tags and leads to the 
payoff matrix 



(tag, T) 


(red, +1) (blue, +1) 


(red, 0) (blue, 0) 


(red, +f) 
(blue, +f) 


b-c b-c 
b-c b-c 


-c -c 
-c -c 


(red, 0) 
(blue, 0) 


b b 
b b 







which describes the prisoners dilemma 



APPENDIX B: FIXED POINTS OF THE 
REPLICATOR DYNAMICS 



with the eigenvalues Ai = 1, A2 = 1 — x and A3 = 1+c—x. 
The fixed point is marginal stable as long as a; > c, for 
X < c it becomes unstable. The reasoning can be adopted 
for the fixed line p"""^ = (0, x, 0). 

A fixed point that is conserved for e > can be found 
if all players are tolerant. For p-^+ = (1 — y,y,Q) the 
Jacobian matrix is given by 



J' 



l + {cy + y)y 

(cy + y) y 

2yyc + cy + e 



—cyy — s 
1 — cyy — e 
~2yyc — cy — e 1 + cy — e 

(B2) 

1 — c. The eigenvalues of this 
-cy—eand A3 = l+c{l—y) — e. 



where y = 1 — y and c = 
matrix are Ai = 1, A2 = f 
Ai < 1 (i = 1,2,3) is not possible for e = 0. Hence 
the fixed line is instable for £ = 0. For e > there 
is an interval of stability given byl — |<?;<|. If 
this inequation and < y < 1 are both fulfilled by y, 
the biased conversions ensure stability of the fixed point 
although the replicator dynamics alone would make this 
point instable. The first inequation can only be fulfilled 
for c < 2 e. For c < e it is always fulfilled and the whole 
fixed line is stable. 

The fixed point given by p*^ — {e/c,e/c,l/2 — e/c) 
reduces to the mixed Nash equilibrium for e = 0. The 
Jacobi matrix at this fixed point is 



1 



3 c e+e- 



3" = 



(1 



2c 

hc)e 



c e—e—c 



(l+c)e 



-(1- 



-c) e 



(c-2e) 
4c 

(1+c) (c-2e) 
I (l-c')(c-2e) 



The eigenvalues of this matrix are 



(B3) 



(B4) 



7(2c-l)- (7 + 8ec+8ec2) 

A2 - 1 H 

4c 

, , 7(2c - 1) + (7 + 8£c + 8£c2) 

A3 IH , 

4c 

where 7 = 2£ — c. For £ = we have Ai=A2 = l — |<1 
and A3 = I — I > 1. The third eigenvalue corresponds to 
an instable direction. The corresponding eigenvector is 
e3 = (l — c, l-|-c,2), which is the normal of the separatrix 



for £ = 0. 
I = 1, 2, 3 only if c > 



In the case of £ > we have Ai < 1 for 
, Hence p'' becomes stable 
where it coincides with the fixed points p^"*" described in 
appendix 10 In all other cases, at least one eigenvalue of 
J'^ is outside the unit circle. 



The stability of the fixed points with only one tag can 
be calculated as follows. For p''^'* = (1 — a;,0, a:) and 
£ = we find the Jacobian matrix 



red 



^ I + {1 ~ x) {c- X + cx) (c - 1) 
c — cx 1 — x cx 

\ (1 - x) (c- X + cx) l + (c-l)a;2 

(Bl) 



APPENDIX C: ADDITIONAL FIXED POINTS 

Numerical simulations show that the additional fixed 
points for £ > can always be found in the plane spanned 
by (1 - c, 0, c), (0, 1 - c, 0) and (0, 0, i). Together with 
p*[^^ = p\ and p*^^ = P3 we have three equations that de- 
scribe these points. Two of the solutions are fixed points 
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not described above. The first fixed points p''^ can be 
written as 



a+\/a/3-2e 

2c 

2c 



4a 



(CI) 



wfiere a = c(l — c) and /3 = a — 4e. p"^ can be calculated 
by exchanging pi withp2 andpa withp4 = l—pi—p2—P3- 
These fixed points have only real coordinates for (3 > 0. 
For f] = we have p*+ = p'*" = p''. 

The eigenvalues of the Jacobi matrix at the fixed points 
p*='= can be calculated numerically. For e ~ 0.01 the fixed 
points are only stable if c > 0.73. At c = i+Vi-i6e 
0.96 they collapse with p'' in a supercritical pitchfork 
bifurcation and form a single stable fixed point . 

For c > 0.73 the fixed points p"^ are the only stable 
attractors and the order measures described in Section 
IIIIDI can be calculated analytically. We find for c < 0.96 



1 -P3{P2+P4) -P4{Pl +PS.) 



(C2) 



5a - 4e(l + c) + 2^0/3 - \/ + 4a/3 + Aa^/aP 



4a 



Ptol 



Pi +P2 



(C3) 



3a - 4£ + 2Va/3 - ^/a^ + 4a/3 + Aa^/aP 



2c 



-P3-P2 -P4\ 



(C4) 



-a + \/a^ + 4a/3 + Aa^/a$ 
2a ■ 



For c > 0.96 the fixed point p'^ becomes stable and we 
find d = i + |, ptoi = 2f and a = 0. 
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